2026-09-30 16:38:19,152 [ 219422 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-09-30 16:38:19,152 [ 219422 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-09-30 16:38:19,152 [ 219422 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-09-30 16:38:19,152 [ 219422 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_c0c2pm --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv" altinityinfra/integration-tests-runner:cf95077f4609 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.4, order-1.0.1, random-0.2, timeout-2.2.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_scheduler/test.py::test_merge_workload test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_restore_replica/test.py::test_restore_replica_alive_replicas test_reload_clusters_config/test.py::test_add_cluster test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_initialization/test.py::test_partially_dropped_tables test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped [gw9] [ 1%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw9] [ 2%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw2] [ 3%] PASSED test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster [gw3] [ 4%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] test_replica_is_active/test.py::test_replica_is_active [gw2] [ 5%] PASSED test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload [gw3] [ 6%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] [gw2] [ 7%] PASSED test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster [gw3] [ 8%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] [gw2] [ 9%] PASSED test_reload_clusters_config/test.py::test_update_one_cluster [gw3] [ 10%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] test_secure_socket/test.py::test [gw3] [ 11%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] [gw3] [ 12%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] [gw3] [ 13%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] [gw8] [ 14%] PASSED test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default [gw8] [ 15%] PASSED test_server_initialization/test.py::test_sophisticated_default [gw1] [ 16%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 17%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 18%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 19%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw3] [ 20%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] [gw1] [ 21%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 22%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 23%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_replica_can_become_leader/test.py::test_can_become_leader [gw1] [ 24%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 25%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 26%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 27%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 28%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 29%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 30%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 31%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 32%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 33%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] [gw1] [ 34%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw1] [ 35%] SKIPPED test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] [gw3] [ 36%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] [gw3] [ 37%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] [gw5] [ 38%] PASSED test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables [gw5] [ 39%] PASSED test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel [gw3] [ 40%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] [gw3] [ 41%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] [gw5] [ 42%] PASSED test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential [gw3] [ 43%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] [gw3] [ 44%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] [gw3] [ 45%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] [gw5] [ 46%] PASSED test_restore_replica/test.py::test_restore_replica_sequential [gw3] [ 47%] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] [gw2] [ 48%] PASSED test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault [gw9] [ 49%] PASSED test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full [gw2] [ 50%] SKIPPED test_send_crash_reports/test.py::test_send_segfault [gw8] [ 51%] PASSED test_replica_can_become_leader/test.py::test_can_become_leader [gw9] [ 52%] PASSED test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_s3_storage_class/test.py::test_s3_storage_class_right [gw4] [ 53%] PASSED test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert [gw4] [ 54%] PASSED test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string [gw4] [ 55%] PASSED test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string [gw4] [ 56%] PASSED test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file [gw4] [ 57%] PASSED test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path [gw4] [ 58%] PASSED test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection [gw6] [ 59%] ERROR test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change [gw6] [ 60%] ERROR test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override [gw6] [ 61%] ERROR test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload [gw6] [ 62%] ERROR test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change [gw6] [ 63%] ERROR test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override [gw6] [ 64%] ERROR test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk [gw6] [ 65%] ERROR test_scheduler/test.py::test_s3_disk [gw4] [ 66%] PASSED test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures [gw4] [ 67%] PASSED test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters [gw4] [ 68%] PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter [gw4] [ 69%] PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting [gw4] [ 70%] PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file [gw4] [ 71%] PASSED test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs [gw4] [ 72%] PASSED test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite [gw4] [ 73%] PASSED test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read [gw4] [ 74%] PASSED test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by [gw4] [ 75%] PASSED test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column [gw4] [ 76%] PASSED test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column [gw4] [ 77%] PASSED test_storage_azure_blob_storage/test.py::test_partition_by_string_column [gw0] [ 78%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] [gw0] [ 79%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] [gw0] [ 80%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] [gw0] [ 81%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] [gw0] [ 82%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] [gw0] [ 83%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] [gw0] [ 84%] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge [gw0] [ 85%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter [gw0] [ 86%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system [gw0] [ 87%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation [gw0] [ 88%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter [gw0] [ 89%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system [gw0] [ 90%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] [gw0] [ 91%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] [gw0] [ 92%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] [gw0] [ 93%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] [gw0] [ 94%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] [gw0] [ 95%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] [gw0] [ 96%] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] [gw7] [ 97%] ERROR test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped [gw7] [ 98%] ERROR test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_relative_filepath/test.py::test_filepath [gw9] [ 99%] ERROR test_s3_storage_class/test.py::test_s3_storage_class_right [gw7] [100%] PASSED test_relative_filepath/test.py::test_filepath ==================================== ERRORS ==================================== ____________________ ERROR at setup of test_merge_workload _____________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Command:['docker ps | wc -l'] Command:['docker ps | wc -l'] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:['docker network prune --force'] Command:['docker network prune --force'] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Running tests in /ClickHouse/tests/integration/test_scheduler/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler_gw6 No running containers for project: roottestscheduler_gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/database Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/database Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/logs Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler_gw6 No running containers for project: roottestscheduler_gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:3 Stdout:3 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestscheduler_gw6 No running containers for project: roottestscheduler_gw6 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:3 Stdout:3 ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:38:23 [ 517 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 517 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:23 [ 517 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:38:23 [ 517 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:38:23 [ 517 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 517 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 517 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:38:23 [ 517 ] INFO : Running tests in /ClickHouse/tests/integration/test_scheduler/test.py (cluster.py:2790, start) 2026-09-30 16:38:23 [ 517 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:38:23 [ 517 ] DEBUG : Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:23 [ 517 ] DEBUG : Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:23 [ 517 ] DEBUG : Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:23 [ 517 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:38:23 [ 517 ] DEBUG : Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:24 [ 517 ] DEBUG : Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:24 [ 517 ] DEBUG : Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:24 [ 517 ] DEBUG : Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:38:24 [ 517 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:38:24 [ 517 ] DEBUG : No running containers for project: roottestscheduler_gw6 (cluster.py:904, cleanup) 2026-09-30 16:38:24 [ 517 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:38:24 [ 517 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:38:24 [ 517 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:24 [ 517 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:24 [ 517 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:38:24 [ 517 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_scheduler/configs/storage_configuration.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml', '/ClickHouse/tests/integration/test_scheduler/configs/resources.xml.default', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml', '/ClickHouse/tests/integration/test_scheduler/configs/workloads.xml.default'] to /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/database (cluster.py:4653, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:38:24 [ 517 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env (cluster.py:86, _create_env_file) 2026-09-30 16:38:24 [ 517 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:24 [ 517 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:24 [ 517 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:24 [ 517 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:24 [ 517 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:38:24 [ 517 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:39:27 [ 517 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:39:27 [ 517 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:39:28 [ 517 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:31 [ 517 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:40:31 [ 517 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:40:33 [ 517 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:34 [ 517 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:41:34 [ 517 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:41:38 [ 517 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:42:37 [ 517 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:42:37 [ 517 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:42:41 [ 517 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:43:41 [ 517 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:43:41 [ 517 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:43:41 [ 517 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:43:41 [ 517 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:41 [ 517 ] DEBUG : Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:41 [ 517 ] DEBUG : Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:41 [ 517 ] DEBUG : Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : No running containers for project: roottestscheduler_gw6 (cluster.py:904, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stdout:3 (cluster.py:121, run_and_check) 2026-09-30 16:43:41 [ 517 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:43:41 [ 517 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Docker networks for project roottestscheduler_gw6 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:43:41 [ 517 ] DEBUG : Docker containers for project roottestscheduler_gw6 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:43:41 [ 517 ] DEBUG : Docker volumes for project roottestscheduler_gw6 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:43:41 [ 517 ] DEBUG : Command:docker container list --all --filter name='^/roottestscheduler_gw6_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : No running containers for project: roottestscheduler_gw6 (cluster.py:904, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:43:41 [ 517 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 517 ] DEBUG : Stdout:3 (cluster.py:121, run_and_check) _________________ ERROR at setup of test_merge_workload_change _________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_merge_workload_override ________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____________________ ERROR at setup of test_mutate_workload ____________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_mutation_workload_change ________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_mutation_workload_override _______________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________________ ERROR at setup of test_s3_disk ________________________ [gw6] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module", autouse=True) def start_cluster(): try: > cluster.start() test_scheduler/test.py:31: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling resolver ... done E Pulling node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_s3_zero_copy_replication[s3] ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Command:['docker ps | wc -l'] Command:['docker ps | wc -l'] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:['docker network prune --force'] Command:['docker network prune --force'] Stderr:Error response from daemon: a prune operation is already running Stderr:Error response from daemon: a prune operation is already running Exitcode:1 Exitcode:1 Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_replication/test.py Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_replication/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3zerocopyreplication_gw0 No running containers for project: roottests3zerocopyreplication_gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/database Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/database Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/logs Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/database Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/database Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/logs Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node2 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... done Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node2 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... done Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo1 ... Pulling node2 ... Pulling node1 ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo1 ... Pulling node2 ... Pulling node1 ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3zerocopyreplication_gw0 No running containers for project: roottests3zerocopyreplication_gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3zerocopyreplication_gw0 No running containers for project: roottests3zerocopyreplication_gw0 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:38:23 [ 499 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 499 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:23 [ 499 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:38:23 [ 499 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:38:23 [ 499 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 499 ] DEBUG : Stderr:Error response from daemon: a prune operation is already running (cluster.py:123, run_and_check) 2026-09-30 16:38:23 [ 499 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:38:23 [ 499 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 499 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:38:23 [ 499 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:38:23 [ 499 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 16:38:23 [ 499 ] DEBUG : Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:38:23 [ 499 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:38:23 [ 499 ] DEBUG : Cluster name: project_name:roottests3zerocopyreplication_gw0. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:38:23 [ 499 ] INFO : Starting cluster... (test.py:33, started_cluster) 2026-09-30 16:38:23 [ 499 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_replication/test.py (cluster.py:2790, start) 2026-09-30 16:38:23 [ 499 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:38:23 [ 499 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:23 [ 499 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:23 [ 499 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:23 [ 499 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:38:23 [ 499 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:24 [ 499 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:24 [ 499 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:24 [ 499 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:38:24 [ 499 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:38:24 [ 499 ] DEBUG : No running containers for project: roottests3zerocopyreplication_gw0 (cluster.py:904, cleanup) 2026-09-30 16:38:24 [ 499 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:38:24 [ 499 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:38:24 [ 499 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:24 [ 499 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:24 [ 499 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 16:38:24 [ 499 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/database (cluster.py:4653, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Setup directory for instance: node2 (cluster.py:2810, start) 2026-09-30 16:38:24 [ 499 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_replication/configs/config.d/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/database (cluster.py:4653, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4750, create_dir) 2026-09-30 16:38:24 [ 499 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env (cluster.py:86, _create_env_file) 2026-09-30 16:38:24 [ 499 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:24 [ 499 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:24 [ 499 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:24 [ 499 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:24 [ 499 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:38:24 [ 499 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:39:59 [ 499 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:39:59 [ 499 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling node2 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... done Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:40:02 [ 499 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:24 [ 499 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:41:24 [ 499 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo1 ... Pulling node2 ... Pulling node1 ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... done Pulling minio1 ... error Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:41:27 [ 499 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:42:58 [ 499 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:42:58 [ 499 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo2 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:43:02 [ 499 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:33 [ 499 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:44:33 [ 499 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:44:37 [ 499 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:46:26 [ 499 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy2 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling resolver ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:46:26 [ 499 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:46:26 [ 499 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:46:26 [ 499 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:26 [ 499 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:26 [ 499 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:26 [ 499 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : No running containers for project: roottests3zerocopyreplication_gw0 (cluster.py:904, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:46:26 [ 499 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:46:26 [ 499 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Docker networks for project roottests3zerocopyreplication_gw0 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:46:26 [ 499 ] DEBUG : Docker containers for project roottests3zerocopyreplication_gw0 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:46:26 [ 499 ] DEBUG : Docker volumes for project roottests3zerocopyreplication_gw0 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:46:26 [ 499 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyreplication_gw0_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : No running containers for project: roottests3zerocopyreplication_gw0 (cluster.py:904, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:46:26 [ 499 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:46:26 [ 499 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _ ERROR at setup of test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] _ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_s3_zero_copy_concurrent_merge _____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_s3_zero_copy_drop_detached_alter ____________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_s3_zero_copy_drop_detached_system ___________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_s3_zero_copy_keeps_data_after_mutation _________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_s3_zero_copy_unfreeze_alter ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_s3_zero_copy_unfreeze_system ______________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_s3_zero_copy_with_ttl_delete[False-10] _________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_s3_zero_copy_with_ttl_delete[True-3] __________ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered-False-10] ______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered-True-3] _______ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] ____ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____ ERROR at setup of test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] _____ [gw0] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/config.d/s3.xml"], macros={"replica": "1"}, with_minio=True, with_zookeeper=True, ) cluster.add_instance( "node2", main_configs=["configs/config.d/s3.xml"], macros={"replica": "2"}, with_minio=True, with_zookeeper=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_zero_copy_replication/test.py:34: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/.env', '--project-name', 'roottests3zerocopyreplication_gw0', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_replication/_instances_0_gw0/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling resolver ... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling node2 ... done E Pulling resolver ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_all_projection_files_are_dropped_when_part_is_dropped _ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) kwargs = args_to_dict( main_configs=[ "configs/config.d/storage_conf.xml", ], user_configs=[ "configs/config.d/users.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) cluster.add_instance("node1", **kwargs) cluster.add_instance("node2", **kwargs) > cluster.start() test_replicated_zero_copy_projection_mutation/test.py:37: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy2 ... E Pulling zoo2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling resolver ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Command:['docker ps | wc -l'] Command:['docker ps | wc -l'] Stdout:1 Stdout:1 No running containers No running containers Pruning Docker networks Pruning Docker networks Command:['docker network prune --force'] Command:['docker network prune --force'] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] Stdout:net.ipv4.ip_local_port_range = 55000 65535 Stdout:net.ipv4.ip_local_port_range = 55000 65535 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 0e632a97ebea ENV HOSTNAME 0e632a97ebea ENV SHLVL 0 ENV SHLVL 0 ENV HOME /root ENV HOME /root ENV OLDPWD / ENV OLDPWD / ENV DOCKER_HELPER_TAG 2cffe1eae894 ENV DOCKER_HELPER_TAG 2cffe1eae894 ENV PYTHONUNBUFFERED 1 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG b74d853ebe76 ENV DOCKER_BASE_TAG b74d853ebe76 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 ENV WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 ENV PYTEST_XDIST_TESTRUNUID dc6a407e58354003afab1dc7246fc126 ENV PYTEST_XDIST_TESTRUNUID dc6a407e58354003afab1dc7246fc126 ENV PYTEST_XDIST_WORKER gw7 ENV PYTEST_XDIST_WORKER gw7 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped (setup) ENV PYTEST_CURRENT_TEST test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped (setup) CLUSTER INIT base_config_dir:/clickhouse-config CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Setup Keeper Setup Keeper Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Running tests in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/test.py Running tests in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 Setup directory for instance: node1 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/database Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/database Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Setup directory for instance: node2 Setup directory for instance: node2 Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/configs/config.d Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/database Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/database Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/logs Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... done Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... done Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling zoo2 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling zoo2 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] Stderr:Pulling zoo1 ... Stderr:Pulling zoo1 ... Stderr:Pulling zoo3 ... Stderr:Pulling zoo3 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling zoo2 ... Stderr:Pulling zoo2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node1 ... Stderr:Pulling node1 ... Stderr:Pulling node2 ... Stderr:Pulling node2 ... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling node2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... status: image is up to date for a... Stderr:Pulling zoo1 ... done Stderr:Pulling zoo1 ... done Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling node1 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... status: image is up to date for a... Stderr:Pulling node2 ... done Stderr:Pulling node2 ... done Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling zoo2 ... status: image is up to date for a... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling node1 ... status: image is up to date for a... Stderr:Pulling zoo2 ... done Stderr:Pulling zoo2 ... done Stderr:Pulling node1 ... done Stderr:Pulling node1 ... done Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... status: image is up to date for a... Stderr:Pulling zoo3 ... done Stderr:Pulling zoo3 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:38:23 [ 550 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 550 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:23 [ 550 ] DEBUG : No running containers (conftest.py:95, cleanup_environment) 2026-09-30 16:38:23 [ 550 ] DEBUG : Pruning Docker networks (conftest.py:97, cleanup_environment) 2026-09-30 16:38:23 [ 550 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 550 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-09-30 16:38:23 [ 550 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV HOSTNAME 0e632a97ebea (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV SHLVL 0 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV HOME /root (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV OLDPWD / (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV TZ Etc/UTC (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV DOCKER_BASE_TAG b74d853ebe76 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV WORKER_FREE_PORTS 30350 30351 30352 30353 30354 30355 30356 30357 30358 30359 30360 30361 30362 30363 30364 30365 30366 30367 30368 30369 30370 30371 30372 30373 30374 30375 30376 30377 30378 30379 30380 30381 30382 30383 30384 30385 30386 30387 30388 30389 30390 30391 30392 30393 30394 30395 30396 30397 30398 30399 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID dc6a407e58354003afab1dc7246fc126 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PYTEST_XDIST_WORKER gw7 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : ENV PYTEST_CURRENT_TEST test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped (setup) (cluster.py:446, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:766, __init__) 2026-09-30 16:38:23 [ 550 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:38:23 [ 550 ] DEBUG : Setup Keeper (cluster.py:1059, setup_keeper_cmd) 2026-09-30 16:38:23 [ 550 ] DEBUG : Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node1 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:38:23 [ 550 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1787, add_instance) 2026-09-30 16:38:23 [ 550 ] DEBUG : Cluster name: project_name:roottestreplicatedzerocopyprojectionmutation_gw7. Added instance name:node2 tag:b74d853ebe76 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2081, add_instance) 2026-09-30 16:38:23 [ 550 ] INFO : Running tests in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/test.py (cluster.py:2790, start) 2026-09-30 16:38:23 [ 550 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:38:23 [ 550 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:23 [ 550 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:23 [ 550 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:23 [ 550 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:38:23 [ 550 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:38:23 [ 550 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:38:24 [ 550 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:38:24 [ 550 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:38:24 [ 550 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:38:24 [ 550 ] DEBUG : No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 (cluster.py:904, cleanup) 2026-09-30 16:38:24 [ 550 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:38:24 [ 550 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:38:24 [ 550 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:38:24 [ 550 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:38:24 [ 550 ] DEBUG : Setup directory for instance: node1 (cluster.py:2810, start) 2026-09-30 16:38:24 [ 550 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/database (cluster.py:4653, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Setup directory for instance: node2 (cluster.py:2810, start) 2026-09-30 16:38:24 [ 550 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/configs/config.d/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/database (cluster.py:4653, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/logs (cluster.py:4664, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:38:24 [ 550 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:b74d853ebe76', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env (cluster.py:86, _create_env_file) 2026-09-30 16:38:24 [ 550 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:24 [ 550 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:24 [ 550 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:38:24 [ 550 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:38:24 [ 550 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:38:24 [ 550 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:40:10 [ 550 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:40:10 [ 550 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo1 ... Pulling zoo2 ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling node2 ... done Pulling proxy2 ... done Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:40:12 [ 550 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:41:55 [ 550 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:41:55 [ 550 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:41:58 [ 550 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:41 [ 550 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:43:41 [ 550 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo1 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling resolver ... Pulling zoo2 ... Pulling node2 ... Pulling node1 ... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling node2 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:43:45 [ 550 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 550 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:45:19 [ 550 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node2 ... Pulling node1 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling node2 ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... done Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:45:24 [ 550 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:47:11 [ 550 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node2 ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling node2 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling node2 ... digest: sha256:2ea9da862c215fd684... Pulling node2 ... status: image is up to date for a... Pulling node2 ... done Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... digest: sha256:2ea9da862c215fd684... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:47:11 [ 550 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:47:11 [ 550 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:47:11 [ 550 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:47:11 [ 550 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:47:11 [ 550 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:47:11 [ 550 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:47:11 [ 550 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:47:11 [ 550 ] DEBUG : No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 (cluster.py:904, cleanup) 2026-09-30 16:47:11 [ 550 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:47:11 [ 550 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:47:11 [ 550 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:47:11 [ 550 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:47:11 [ 550 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:47:11 [ 550 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:47:12 [ 550 ] DEBUG : Docker networks for project roottestreplicatedzerocopyprojectionmutation_gw7 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:47:12 [ 550 ] DEBUG : Docker containers for project roottestreplicatedzerocopyprojectionmutation_gw7 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:47:12 [ 550 ] DEBUG : Docker volumes for project roottestreplicatedzerocopyprojectionmutation_gw7 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:47:12 [ 550 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedzerocopyprojectionmutation_gw7_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:47:12 [ 550 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:47:12 [ 550 ] DEBUG : No running containers for project: roottestreplicatedzerocopyprojectionmutation_gw7 (cluster.py:904, cleanup) 2026-09-30 16:47:12 [ 550 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:47:12 [ 550 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:47:12 [ 550 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:47:12 [ 550 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ______ ERROR at setup of test_hardlinks_preserved_when_projection_dropped ______ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) kwargs = args_to_dict( main_configs=[ "configs/config.d/storage_conf.xml", ], user_configs=[ "configs/config.d/users.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) cluster.add_instance("node1", **kwargs) cluster.add_instance("node2", **kwargs) > cluster.start() test_replicated_zero_copy_projection_mutation/test.py:37: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/.env', '--project-name', 'roottestreplicatedzerocopyprojectionmutation_gw7', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_replicated_zero_copy_projection_mutation/_instances_0_gw7/node2/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy2 ... E Pulling zoo2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node1 ... E Pulling node2 ... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling node2 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling resolver ... done E Pulling node2 ... digest: sha256:2ea9da862c215fd684... E Pulling node2 ... status: image is up to date for a... E Pulling node2 ... done E Pulling zoo2 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo2 ... status: image is up to date for a... E Pulling node1 ... digest: sha256:2ea9da862c215fd684... E Pulling node1 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo3 ... digest: sha256:2ea9da862c215fd684... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_s3_storage_class_right _________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: > cluster.start() test_s3_storage_class/test.py:22: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2831: in start retry(log_function=logging_pulling_images)(run_and_check)( helpers/retry_decorator.py:28: in wrapper raise e helpers/retry_decorator.py:19: in wrapper func(*args, **kwargs) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 900 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling resolver ... E Pulling minio1 ... E Pulling node ... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling node ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node ... digest: sha256:2ea9da862c215fd684... E Pulling node ... status: image is up to date for a... E Pulling node ... done E Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py Cluster start called. is_up=False Cluster start called. is_up=False Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Cleanup called Cleanup called Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass_gw9 No running containers for project: roottests3storageclass_gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:3 Stdout:3 Setup directory for instance: node Setup directory for instance: node Create directory for configuration generated in this helper Create directory for configuration generated in this helper Create directory for common tests configuration Create directory for common tests configuration Copy common configuration from helpers Copy common configuration from helpers Generate and write macros file Generate and write macros file Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/configs/config.d Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/database Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/database Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/logs Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/logs Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found No config file found http://localhost:None "GET /version HTTP/1.1" 200 825 http://localhost:None "GET /version HTTP/1.1" 200 825 Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] Stderr:Pulling proxy2 ... Stderr:Pulling proxy2 ... Stderr:Pulling proxy1 ... Stderr:Pulling proxy1 ... Stderr:Pulling resolver ... Stderr:Pulling resolver ... Stderr:Pulling minio1 ... Stderr:Pulling minio1 ... Stderr:Pulling node ... Stderr:Pulling node ... Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling node ... pulling from altinityinfra/integr... Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling resolver ... pulling from altinityinfra/python... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... status: image is up to date for a... Stderr:Pulling proxy2 ... done Stderr:Pulling proxy2 ... done Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... status: image is up to date for a... Stderr:Pulling node ... done Stderr:Pulling node ... done Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling proxy1 ... status: image is up to date for a... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling resolver ... status: image is up to date for a... Stderr:Pulling proxy1 ... done Stderr:Pulling proxy1 ... done Stderr:Pulling resolver ... done Stderr:Pulling resolver ... done Stderr:Pulling minio1 ... error Stderr:Pulling minio1 ... error Stderr: Stderr: Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Exitcode:1 Exitcode:1 Failed to start cluster: Failed to start cluster: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2831, in start retry(log_function=logging_pulling_images)(run_and_check)( File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 28, in wrapper raise e File "/ClickHouse/tests/integration/helpers/retry_decorator.py", line 19, in wrapper func(*args, **kwargs) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied None None docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass_gw9 No running containers for project: roottests3storageclass_gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 docker-compose up was not called. Trying to export docker.log for running containers docker-compose up was not called. Trying to export docker.log for running containers Cleanup called Cleanup called Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' Unstopped containers: {} Unstopped containers: {} No running containers for project: roottests3storageclass_gw9 No running containers for project: roottests3storageclass_gw9 Trying to prune unused networks... Trying to prune unused networks... Trying to prune unused volumes... Trying to prune unused volumes... Command:['docker volume ls | wc -l'] Command:['docker volume ls | wc -l'] Stdout:1 Stdout:1 ------------------------------ Captured log setup ------------------------------ 2026-09-30 16:42:24 [ 586 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_storage_class/test.py (cluster.py:2790, start) 2026-09-30 16:42:24 [ 586 ] DEBUG : Cluster start called. is_up=False (cluster.py:2797, start) 2026-09-30 16:42:24 [ 586 ] DEBUG : Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:42:24 [ 586 ] DEBUG : Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:42:24 [ 586 ] DEBUG : Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:42:24 [ 586 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:42:25 [ 586 ] DEBUG : Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:42:25 [ 586 ] DEBUG : Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:42:25 [ 586 ] DEBUG : Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:42:25 [ 586 ] DEBUG : Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:42:25 [ 586 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:42:25 [ 586 ] DEBUG : No running containers for project: roottests3storageclass_gw9 (cluster.py:904, cleanup) 2026-09-30 16:42:25 [ 586 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:42:25 [ 586 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:42:25 [ 586 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:42:25 [ 586 ] DEBUG : Stdout:3 (cluster.py:121, run_and_check) 2026-09-30 16:42:25 [ 586 ] DEBUG : Setup directory for instance: node (cluster.py:2810, start) 2026-09-30 16:42:25 [ 586 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4538, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Create directory for common tests configuration (cluster.py:4543, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Copy common configuration from helpers (cluster.py:4563, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Generate and write macros file (cluster.py:4606, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_storage_class/configs/config.d/minio.xml'] to /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/configs/config.d (cluster.py:4636, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/database (cluster.py:4653, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/logs (cluster.py:4664, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4750, create_dir) 2026-09-30 16:42:25 [ 586 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env (cluster.py:86, _create_env_file) 2026-09-30 16:42:25 [ 586 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:42:25 [ 586 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:42:25 [ 586 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-09-30 16:42:25 [ 586 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-09-30 16:42:25 [ 586 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 825 (connectionpool.py:547, _make_request) 2026-09-30 16:42:25 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:43:19 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:43:19 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:43:22 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:44:23 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:44:23 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:44:25 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:45:19 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:45:19 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:45:23 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:46:26 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:46:26 [ 586 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... done Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2827, logging_pulling_images) 2026-09-30 16:46:30 [ 586 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling node ... digest: sha256:2ea9da862c215fd684... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-09-30 16:47:32 [ 586 ] DEBUG : Failed to start cluster: (cluster.py:3178, start) 2026-09-30 16:47:32 [ 586 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:2c143e57962bb1494a... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... digest: sha256:2ea9da862c215fd684... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... digest: sha256:2c143e57962bb1494a... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:919cb0e6c1a4f05e8d... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3179, start) 2026-09-30 16:47:32 [ 586 ] DEBUG : None (cluster.py:3180, start) 2026-09-30 16:47:32 [ 586 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:47:32 [ 586 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:47:32 [ 586 ] DEBUG : Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:47:32 [ 586 ] DEBUG : Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:47:33 [ 586 ] DEBUG : Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:47:33 [ 586 ] DEBUG : Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:47:33 [ 586 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : No running containers for project: roottests3storageclass_gw9 (cluster.py:904, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:47:33 [ 586 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-09-30 16:47:33 [ 586 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3246, shutdown) 2026-09-30 16:47:33 [ 586 ] DEBUG : Cleanup called (cluster.py:876, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : Docker networks for project roottests3storageclass_gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:855, print_all_docker_pieces) 2026-09-30 16:47:33 [ 586 ] DEBUG : Docker containers for project roottests3storageclass_gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:863, print_all_docker_pieces) 2026-09-30 16:47:33 [ 586 ] DEBUG : Docker volumes for project roottests3storageclass_gw9 are DRIVER VOLUME NAME (cluster.py:871, print_all_docker_pieces) 2026-09-30 16:47:33 [ 586 ] DEBUG : Command:docker container list --all --filter name='^/roottests3storageclass_gw9_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-09-30 16:47:33 [ 586 ] DEBUG : Unstopped containers: {} (cluster.py:890, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : No running containers for project: roottests3storageclass_gw9 (cluster.py:904, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : Trying to prune unused networks... (cluster.py:910, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : Trying to prune unused volumes... (cluster.py:937, cleanup) 2026-09-30 16:47:33 [ 586 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-09-30 16:47:33 [ 586 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) =============================== warnings summary =============================== test_storage_azure_blob_storage/test.py: 1023 warnings /usr/local/lib/python3.10/dist-packages/azure/storage/blob/_container_client.py:1781: DeprecationWarning: The use of a 'BlobProperties' instance for param blob is deprecated. Please use 'BlobProperties.name' or any other str input type instead. warnings.warn( -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 528.34s setup test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped 482.76s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] 317.63s setup test_scheduler/test.py::test_merge_workload 308.38s setup test_s3_storage_class/test.py::test_s3_storage_class_right 244.91s call test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade 104.99s setup test_restore_replica/test.py::test_restore_replica_alive_replicas 104.69s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 103.34s setup test_server_initialization/test.py::test_partially_dropped_tables 103.34s setup test_replica_can_become_leader/test.py::test_can_become_leader 95.90s setup test_replica_is_active/test.py::test_replica_is_active 63.93s setup test_reload_clusters_config/test.py::test_add_cluster 63.24s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] 58.47s setup test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade 55.25s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 54.90s setup test_relative_filepath/test.py::test_filepath 51.52s setup test_secure_socket/test.py::test 51.44s setup test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full 37.17s setup test_send_crash_reports/test.py::test_send_segfault 19.51s teardown test_restore_replica/test.py::test_restore_replica_sequential 17.34s call test_secure_socket/test.py::test 10.88s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] 10.80s call test_restore_replica/test.py::test_restore_replica_alive_replicas 10.33s call test_restore_replica/test.py::test_restore_replica_sequential 9.88s call test_restore_replica/test.py::test_restore_replica_parallel 7.99s teardown test_secure_socket/test.py::test 7.55s teardown test_reload_clusters_config/test.py::test_update_one_cluster 6.90s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 6.88s call test_storage_azure_blob_storage/test.py::test_format_detection 6.70s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 6.38s teardown test_replica_can_become_leader/test.py::test_can_become_leader 6.34s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 6.25s teardown test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full 6.11s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] 6.01s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] 5.93s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] 5.92s call test_replica_is_active/test.py::test_replica_is_active 5.66s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] 5.60s call test_reload_clusters_config/test.py::test_delete_cluster 5.29s call test_reload_clusters_config/test.py::test_update_one_cluster 5.22s teardown test_send_crash_reports/test.py::test_send_segfault 5.11s setup test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert 5.06s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] 5.02s teardown test_replica_is_active/test.py::test_replica_is_active 4.95s teardown test_storage_azure_blob_storage/test.py::test_partition_by_string_column 4.87s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] 4.82s call test_reload_clusters_config/test.py::test_add_cluster 4.81s teardown test_relative_filepath/test.py::test_filepath 4.68s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] 4.52s call test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full 4.47s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] 4.44s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] 4.34s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] 4.33s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] 4.29s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] 4.21s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] 4.17s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] 4.14s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] 3.82s call test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] 3.52s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 2.58s call test_storage_azure_blob_storage/test.py::test_function_signatures 2.43s call test_reload_clusters_config/test.py::test_simple_reload 2.29s teardown test_server_initialization/test.py::test_sophisticated_default 1.82s call test_storage_azure_blob_storage/test.py::test_overwrite 1.81s call test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert 1.68s call test_storage_azure_blob_storage/test.py::test_parallel_read 1.65s call test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path 0.80s call test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs 0.75s call test_storage_azure_blob_storage/test.py::test_insert_create_new_file 0.75s call test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter 0.75s call test_restore_replica/test.py::test_restore_replica_invalid_tables 0.72s call test_storage_azure_blob_storage/test.py::test_partition_by 0.72s call test_relative_filepath/test.py::test_filepath 0.72s call test_storage_azure_blob_storage/test.py::test_partition_by_string_column 0.66s call test_storage_azure_blob_storage/test.py::test_partition_by_const_column 0.58s call test_storage_azure_blob_storage/test.py::test_filter_using_file 0.55s call test_server_initialization/test.py::test_partially_dropped_tables 0.53s call test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters 0.53s call test_send_crash_reports/test.py::test_send_segfault 0.48s call test_replica_can_become_leader/test.py::test_can_become_leader 0.48s call test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting 0.43s call test_storage_azure_blob_storage/test.py::test_create_table_connection_string 0.43s call test_storage_azure_blob_storage/test.py::test_create_table_account_string 0.43s call test_server_initialization/test.py::test_sophisticated_default 0.32s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.28s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.27s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.27s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.27s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.22s call test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.05s setup test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path 0.04s setup test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs 0.04s setup test_storage_azure_blob_storage/test.py::test_format_detection 0.03s setup test_storage_azure_blob_storage/test.py::test_partition_by 0.03s setup test_storage_azure_blob_storage/test.py::test_partition_by_const_column 0.03s setup test_storage_azure_blob_storage/test.py::test_create_table_account_string 0.03s setup test_storage_azure_blob_storage/test.py::test_partition_by_string_column 0.03s setup test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting 0.02s setup test_storage_azure_blob_storage/test.py::test_overwrite 0.02s setup test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters 0.02s setup test_storage_azure_blob_storage/test.py::test_parallel_read 0.02s setup test_storage_azure_blob_storage/test.py::test_create_table_connection_string 0.02s setup test_storage_azure_blob_storage/test.py::test_function_signatures 0.02s setup test_storage_azure_blob_storage/test.py::test_filter_using_file 0.02s setup test_storage_azure_blob_storage/test.py::test_insert_create_new_file 0.02s setup test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter 0.00s teardown test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade 0.00s teardown test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert 0.00s teardown test_reload_clusters_config/test.py::test_add_cluster 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] 0.00s teardown test_restore_replica/test.py::test_restore_replica_parallel 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] 0.00s teardown test_restore_replica/test.py::test_restore_replica_alive_replicas 0.00s teardown test_storage_azure_blob_storage/test.py::test_partition_by_const_column 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] 0.00s teardown test_storage_azure_blob_storage/test.py::test_create_table_account_string 0.00s setup test_restore_replica/test.py::test_restore_replica_invalid_tables 0.00s teardown test_storage_azure_blob_storage/test.py::test_filter_using_file 0.00s teardown test_storage_azure_blob_storage/test.py::test_partition_by 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] 0.00s teardown test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting 0.00s teardown test_s3_storage_class/test.py::test_s3_storage_class_right 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] 0.00s teardown test_storage_azure_blob_storage/test.py::test_parallel_read 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_restore_replica/test.py::test_restore_replica_sequential 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] 0.00s teardown test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped 0.00s teardown test_storage_azure_blob_storage/test.py::test_overwrite 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] 0.00s teardown test_storage_azure_blob_storage/test.py::test_insert_create_new_file 0.00s teardown test_scheduler/test.py::test_s3_disk 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_storage_azure_blob_storage/test.py::test_create_table_connection_string 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] 0.00s teardown test_server_initialization/test.py::test_partially_dropped_tables 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] 0.00s teardown test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] 0.00s teardown test_scheduler/test.py::test_merge_workload 0.00s teardown test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_storage_azure_blob_storage/test.py::test_format_detection 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 0.00s setup test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped 0.00s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] 0.00s setup test_reload_clusters_config/test.py::test_update_one_cluster 0.00s teardown test_scheduler/test.py::test_merge_workload_change 0.00s setup test_restore_replica/test.py::test_restore_replica_parallel 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] 0.00s setup test_scheduler/test.py::test_merge_workload_change 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 0.00s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 0.00s setup test_server_initialization/test.py::test_sophisticated_default 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter 0.00s teardown test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path 0.00s teardown test_scheduler/test.py::test_merge_workload_override 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] 0.00s teardown test_scheduler/test.py::test_mutation_workload_override 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] 0.00s teardown test_reload_clusters_config/test.py::test_delete_cluster 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] 0.00s teardown test_scheduler/test.py::test_mutate_workload 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] 0.00s teardown test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system 0.00s teardown test_scheduler/test.py::test_mutation_workload_change 0.00s teardown test_storage_azure_blob_storage/test.py::test_function_signatures 0.00s setup test_reload_clusters_config/test.py::test_delete_cluster 0.00s setup test_reload_clusters_config/test.py::test_simple_reload 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] 0.00s setup test_scheduler/test.py::test_merge_workload_override 0.00s teardown test_reload_clusters_config/test.py::test_simple_reload 0.00s teardown test_restore_replica/test.py::test_restore_replica_invalid_tables 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] 0.00s teardown test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] 0.00s teardown test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] 0.00s setup test_scheduler/test.py::test_mutation_workload_override 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] 0.00s setup test_scheduler/test.py::test_mutate_workload 0.00s teardown test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}] 0.00s setup test_scheduler/test.py::test_mutation_workload_change 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system 0.00s setup test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge 0.00s setup test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] 0.00s setup test_scheduler/test.py::test_s3_disk =========================== short test summary info ============================ ERROR test_scheduler/test.py::test_merge_workload - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_merge_workload_change - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_merge_workload_override - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_mutate_workload - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_mutation_workload_change - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_mutation_workload_override - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_scheduler/test.py::test_s3_disk - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/.env', '--project-name', 'roottestscheduler_gw6', '--file', '/ClickHouse/tests/integration/test_scheduler/_instances_0_gw6/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op] ERROR test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10] ERROR test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3] ERROR test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped ERROR test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped ERROR test_s3_storage_class/test.py::test_s3_storage_class_right - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/.env', '--project-name', 'roottests3storageclass_gw9', '--file', '/ClickHouse/tests/integration/test_s3_storage_class/_instances_0_gw9/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 PASSED test_reload_clusters_config/test.py::test_add_cluster PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0] PASSED test_reload_clusters_config/test.py::test_delete_cluster PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1] PASSED test_reload_clusters_config/test.py::test_simple_reload PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0] PASSED test_reload_clusters_config/test.py::test_update_one_cluster PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0] PASSED test_server_initialization/test.py::test_partially_dropped_tables PASSED test_server_initialization/test.py::test_sophisticated_default PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1] PASSED test_restore_replica/test.py::test_restore_replica_alive_replicas PASSED test_restore_replica/test.py::test_restore_replica_invalid_tables PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1] PASSED test_restore_replica/test.py::test_restore_replica_parallel PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1] PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0] PASSED test_restore_replica/test.py::test_restore_replica_sequential PASSED test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1] PASSED test_secure_socket/test.py::test PASSED test_replica_is_active/test.py::test_replica_is_active PASSED test_replica_can_become_leader/test.py::test_can_become_leader PASSED test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full PASSED test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade PASSED test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert PASSED test_storage_azure_blob_storage/test.py::test_create_table_account_string PASSED test_storage_azure_blob_storage/test.py::test_create_table_connection_string PASSED test_storage_azure_blob_storage/test.py::test_filter_using_file PASSED test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path PASSED test_storage_azure_blob_storage/test.py::test_format_detection PASSED test_storage_azure_blob_storage/test.py::test_function_signatures PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter PASSED test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting PASSED test_storage_azure_blob_storage/test.py::test_insert_create_new_file PASSED test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs PASSED test_storage_azure_blob_storage/test.py::test_overwrite PASSED test_storage_azure_blob_storage/test.py::test_parallel_read PASSED test_storage_azure_blob_storage/test.py::test_partition_by PASSED test_storage_azure_blob_storage/test.py::test_partition_by_const_column PASSED test_storage_azure_blob_storage/test.py::test_partition_by_string_column PASSED test_relative_filepath/test.py::test_filepath SKIPPED [19] test_parallel_replicas_all_marks_read/test.py:135: Disabled for sanitizers (too slow) SKIPPED [1] test_send_crash_reports/test.py:45: doesn't fit in timeouts for stacktrace generation ===== 51 passed, 20 skipped, 1023 warnings, 29 errors in 590.98s (0:09:50) ===== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 445, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_c0c2pm --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=b74d853ebe76 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[1-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-10-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-1000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-10000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name} WHERE intDiv(key, 100) IN {rand_set}]' 'test_parallel_replicas_all_marks_read/test.py::test_number_of_marks_read[10-100-100000-SELECT sum(cityHash64(*)) FROM {table_name}]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[0-custom_key_sampling-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_range-sipHash64(key)-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-key-1]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-0]' 'test_parallel_replicas_custom_key_failover/test.py::test_parallel_replicas_custom_key_failover[1-custom_key_sampling-sipHash64(key)-1]' test_relative_filepath/test.py::test_filepath test_reload_clusters_config/test.py::test_add_cluster test_reload_clusters_config/test.py::test_delete_cluster test_reload_clusters_config/test.py::test_simple_reload test_reload_clusters_config/test.py::test_update_one_cluster test_replica_can_become_leader/test.py::test_can_become_leader test_replica_is_active/test.py::test_replica_is_active test_replicated_merge_tree_thread_schedule_timeouts/test.py::test_query_exception_on_thread_pool_full test_replicated_zero_copy_projection_mutation/test.py::test_all_projection_files_are_dropped_when_part_is_dropped test_replicated_zero_copy_projection_mutation/test.py::test_hardlinks_preserved_when_projection_dropped test_restore_replica/test.py::test_restore_replica_alive_replicas test_restore_replica/test.py::test_restore_replica_invalid_tables test_restore_replica/test.py::test_restore_replica_parallel test_restore_replica/test.py::test_restore_replica_sequential test_s3_storage_class/test.py::test_s3_storage_class_right 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[None-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_after_op-zero_copy_lock_zk_fail_before_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_after_op]' 'test_s3_zero_copy_replication/test.py::test_move_shared_zero_copy_lock_fail[zero_copy_unlock_zk_fail_before_op-zero_copy_lock_zk_fail_before_op]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_concurrent_merge test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_drop_detached_system test_s3_zero_copy_replication/test.py::test_s3_zero_copy_keeps_data_after_mutation 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_replication[s3]' test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_alter test_s3_zero_copy_replication/test.py::test_s3_zero_copy_unfreeze_system 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_delete[True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered-True-3]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-False-10]' 'test_s3_zero_copy_replication/test.py::test_s3_zero_copy_with_ttl_move[tiered_copy-True-3]' test_scheduler/test.py::test_merge_workload test_scheduler/test.py::test_merge_workload_change test_scheduler/test.py::test_merge_workload_override test_scheduler/test.py::test_mutate_workload test_scheduler/test.py::test_mutation_workload_change test_scheduler/test.py::test_mutation_workload_override test_scheduler/test.py::test_s3_disk test_secure_socket/test.py::test test_send_crash_reports/test.py::test_send_segfault test_server_initialization/test.py::test_partially_dropped_tables test_server_initialization/test.py::test_sophisticated_default test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_storage_azure_blob_storage/test.py::test_azure_glob_scheherazade test_storage_azure_blob_storage/test.py::test_create_new_files_on_insert test_storage_azure_blob_storage/test.py::test_create_table_account_string test_storage_azure_blob_storage/test.py::test_create_table_connection_string test_storage_azure_blob_storage/test.py::test_filter_using_file test_storage_azure_blob_storage/test.py::test_filtering_by_file_or_path test_storage_azure_blob_storage/test.py::test_format_detection test_storage_azure_blob_storage/test.py::test_function_signatures test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_all_parameters test_storage_azure_blob_storage/test.py::test_hive_partitioning_with_one_parameter test_storage_azure_blob_storage/test.py::test_hive_partitioning_without_setting test_storage_azure_blob_storage/test.py::test_insert_create_new_file test_storage_azure_blob_storage/test.py::test_insert_with_path_with_globs test_storage_azure_blob_storage/test.py::test_overwrite test_storage_azure_blob_storage/test.py::test_parallel_read test_storage_azure_blob_storage/test.py::test_partition_by test_storage_azure_blob_storage/test.py::test_partition_by_const_column test_storage_azure_blob_storage/test.py::test_partition_by_string_column -vvv" altinityinfra/integration-tests-runner:cf95077f4609 ' returned non-zero exit status 1.